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‘ le -s baven't really been delaying pe ee ‘there just’ been out of: 
town. This is a formidable problem you have tackled, however, ana-I wouldn't 
be above evading it. I am sure I haven't any solutions, but'I do have some. 
ideas Which I em glef to pass along. In answer to your first question, “Ie it 
likely that the Army Officer Efficiency Report with its. "expected distribution 
of 100 officers rated' formula is likely to be any more meaningful than our 
fitness reports", I don't know. I know that on ite one form the Army tries to 
increase variability of ratings between people dy use of thia ki 
forma. .On another form they try to increase variability in ratings on one 
individual by exhortations to avoid the "halo effect". Similar formas ani 
admonitions could be maile an integral part of the instructions on any rating 
sheets Whether or not they would be effeetive cowld probably be dete 
by looking - at the Army results. J don't have the data, but assume. we. ean find 
out whet sort of distribution the ratings follow on officers' efficiency reports. 
But even here I am not sure that the proof of the pwiding would be in the eating. 
What worked for the Army might not work for us. I suspect that Army officers have 
more in common than Agency employees, and that it is easier for an Army rater tc 
compare any one ratee with a large group of other people. A major problem in 
fitness report ratings is defining a reference group. . “For | bean 16 
on ARE psyehologist might do it quite differently depend: 
rating the ‘individual against an ideal standanl, against other psychologis 
against ‘other support uppart people, or against other heey auployecd f the same 
A forced distribution of ratings among individuals works *best when y 
person rating many others in the same jobs. In that case you Gan insist on grading 
by the curve or on a fixed percentage of people at each ¥ating.’. If a person is 
only rating a few others, it is easy for him to rationalize that they are all. 
top-notch ‘people; and, in fact, they may be. : 


2. I do know that the service iii a Sate Olde Waive Meese eee luck 
with their fitness reports than we do. About ten years ago I was involved in « 
large scale psychological stwiy of Air Force offisers. Mundreds of thousands of 
dollars and mach valuable time of Air Foree officers and ‘psyekolo Ogists was spent 
amassing a plethora of data intended to be combined to predict officer effective - 


"ness. Kot one trait was worated nor one trauma unanalyzed, but the entire study 


nearly foundered on the shoals of attemated eriteria; all. got the same ratings 
on thelr efficiensy. reports. The data could not. zo be. rel 

bad performance in eich circumstances, Luckily sau e Was 

soueone hed had the foresight to obtain experimental, ‘Sonfidential ratings un- 
related to the OER's. I frankly doubt that Ae Pete oreo mack 


as, 
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____3+ On your second point, basieally I think I am against minor changes in 
ritness reports exeept for more effective instructions. The fitness report 
represents a chronological history of the individual's pérformance, and shanges 
i: the form make for problems of confusion vhen a reviewer is attempting to 
svudy a personnel file. It may be completely unfeasible, 
worthwhile at least to consider the possibility of B aiely re 
of the purposes of the fitupas report is xf 
- iividual'’s performance for the puisonnel file, The present syeler. 
aM any close to it, I suspect, will provide mainly eyparfieial information 
Sheer aii ar ; discussion. AS 


es 


sown hin fitness repo. 
superficial product will be the résult. Anyone whd"Kas $¥ér sat on a sardine 
panel knows there is more meaningful data which is ugaally presented orally «ua 
- “ormally. It may be that the interest of the Agency could be served by in- 
“porating some of this into a portion of the fitness report not shown the 
Sadividuel. It may also be that this smacks too meh-of authoritarianism. 
Ferhaps the fitness report has more value as a motivating deyice and as a focu: 
_“¢ conversation between auperyiegor and supervisee than as a valid rating instr. - 
.t. Although 1 am pessimistic about results. I an @reatly in favor of a r+ 
the system. If we can help by reviewing waat is béing don# elsewhere ani - 
“AP Teva personne. research, pléase ask. 


Zoe ASA 
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